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ABSTRACT 


The  extremal  large  deviation  Tate  of  the  F- statistic  over  a  large  class  is*determined. 
It  is  shown  that  the  Bahadur  efficiency  of  the  F-tefct  relative  to  Moses'  rank  test 
for  equality  of  variances  is  zero  at  every  alternative  when  the  distribution  of 
the  underlying  observations  iS  unspecified. 
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I.  Introduction.  Extremal,  large  deviation  rates  measure  the  slowest  rate  of  con¬ 
vergence*  to  zero  of  certain  sequences  of  probabilities.  When  these  probabilities 
arise  from  a  sequence  of  test  statistics,  extremal  large  deviation  rates  find 
application  in  the  computation  of  asymptotic  relative  efficiency  (ARE)  of  tests, 
such  as  Bahadur's  definition  of  ARE. 

The  extremal  large  deviation  rate  of  only  a  few  common  statistics  is  known. 
Here  we  will  determine  the  extremal  large  deviation  rate  of  the  F- statistic. 

Before  precisely  defining  extremal  large  deviation  rates,  we  will  discuss 
Bahadur's  definition  of  ARE,  in  which  it  finds  application.  Let  (X,  A)  be  a 
measurable  space.  Let  X  ■  be  a  sequence  of  random  variables  on 

(X,  A) ,  and  let  F  be  a  probability  measure  on  (X,  A)  such  that  £  is  a  sequence 
of  independent  identically  distributed  random  variables  with  common  distribution 
Pp.  Let  C  and  C'  be  disjoint  non-empty  collections  of  distributions,  and 
consider  the  problem  of  testing 

H  :  P  c  C  vs.  H  :  P  e  C'. 
o  a 

Typically,  decision  rules  are  of  the  form  "reject  Hq  if  Sn  exceeds  some 

specified  value  a",  where  S„  is  a  measurable  real  valued  function  of  {X.}!?  that 

n  x  x*i 

is  S  -  is  a  sequence  of  test  statistics.  Call  this  test  Tg(a). 

Let  S'  *  be  another  sequence  of  test  statistics.  Call  the  test 

that  rejects  Hq  when  exceeds  a  specified  value,  say  a',  Ts,(a').  The  test 
Tg , (a ' )  is  a  competitor  to  the  test  T (a) .  We  choosy  between  these  tests  by 
considering  their  ARE. 

The  most  important  definitions  of  ARE  are  due  to  Pitman,  (1949) ,  Hodges - 
Lehmann  (3956),  and  Bahadur  (1960).  Under  mild  regularity  conditions,  evaluation 
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of  the  Bahadur  efficiency  of  Tg(a)  relative  to  Tg,  (a*) 
determination  of  extremal  large  deviations  rates  of  {S^} 

We  now  make  precise  the  concept  of  an  extremal  large 

Definition  1:  If 

W(S,  C,  a)  *  -lim  n  *  log  sup  P(S  i  a) 
n*»  PeC  n 

is  well  defined,  we  say  that  W(S,  C,  a)  is  the  extremal  large  deviation  rate  at 
a  deviation  of  a  for  the  sequence  §  under  the  class  of  probability  models  C. 

That  is,  W(§,  C,  a)  is  a  measure  of  the  rate  at  which 

sup  P(S  a  a) 

PeC  n 

converges  to  zero. 

Let  C  be  such  that  for  every  PeC, 

P(Sn  +  0)  •  1. 

Consider  the  test  T  (a),  where  a  >  0.  New  F*(a)  -  sup  P(S  *  a)  is  the  signi- 

s  n  PeC 

ficance  level  of  Ts(a),  and  LR  -  FJJ(Sn)  is  the  usual  observed  significance 
level.  If  P  e  P(Ln  +  0)  «  0.  If  P  4  C  (in  particular,  if  P  e  C\  the 
alternative  class),  then  P(Ln  0)  «  3 ,  In  typical  cases,  Ln  converges  to 
zero  exponentially  fast  at  non-null  P. 

Definition  2:  The  half  slope  of  Tg(  )  at  non-null  P  is  given  by 

^(P)  *  -lim  n~*  log  Ln  CP] 

when  the  above  is  well  defined. 
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We  may  interpret  p(P)  as  a  measure  of  the  rate  at  which  the  observed 
significance  level  tends  to  zero,  with  large  values  indicating  more  rapid 
convergence.  Bahadur  has  exploited  this  property  to  define  a  measure  of  ARE, 
described  below. 

Definition  3;  Let  T  (•)  and  Ts,0)  be  as  defined  earlier.  At  non-null  P, 
let  Tcf*)  have  half  slope  p(P)  and  let  Tg , C * )  have  half  slope  p'(P).  The 
Bahadur  efficiency  of  Ts(0>  relative  to  Tg,(*)»  at  non-null  P  is  given  by 
p(P)/p’(P). 

The  following  theorem,  due  to  Bahadur,  relates  the  concepts  of  half  slope 
and  extremal  large  deviation  rates. 

Theorem  1;  (Bahadur,  1960).  Let  P(Sn  -►  a(P))  »  1  at  non-null  P.  Let 

W(S,  C,  t)  be  well  defined  for  t  in  a  neighborhood  of  a(P)  and  continuous 

at  t  *  a(P).  Then  p(P)  -  W(S,  C,  a(P)). 

-1  n 

Consider  the  case  S  »  n  j>  X.,  where  C  consists  of  a  single  distribution 
n  i=l  1 

F  and  JxdF(x)  =  0.  Using  Chemoff's  Theorem,  stated  below,  evaluation  of  the 
half  slope  of  3  at  a  fixed  non- null  distribution' is  straightforward. 

Theorem  2:  (Chemoff,  1952).  Let  {X.}^  be  a  sequence  of  i.i.d.  random 

i  i  i 

variables.  Let  <j>(t)  s  Ee  ,  not  necessarily  finite  for  t  *  0.  Then  for 
every  real  a, 

-1  _i  ft  -at 

lira  n  1  log  P(n  1  l  X.  a  a)  =  inf  log  <j>(t)e 

n-*»  i*l  1  taO 

Hence,  at  non-mil  G,  the  half  slope  of  S  equals  -inf  log  \p(t)e'at  where 

taO 

ip (t)  -  Je  dF(x)  and  a  =  JxdG(x), 
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II.  Large  Deviation  Rates  of  the  F- Statistic 

Extremal  large  deviation  rates  over  a  large  class  have  only  been  evaluated 
in  a  few  instances.  For  example,  if  the  statistic  of  interest  is  a  linear 
rank  statistic,  a  straightforward  method  exists.  See  Klotz  (1965),  who 
evaluates  the  half  slope  of  the  Wilcoxon  rank  sum  statistic,  as  well  as  other 
linear  rank  statistics. 

One  of  the  few  non- distribution- free  statistics  for  which  the  extremal 
large  deviation  rate  has  been  studied  is  the  t-statistic. 


Theorem  5:  (Jones  and  Sethuraman,  1978).  Let  {Y^}?  ^  be  two  sequences 

of  mutually  independent  identically  distributed  random  variables,  with  common 
distribution  F  and  joint  distribution  Pp.  Let 


.i  n  .i  n 

X„  a  n  l  “  n  l 

n  A  1  n  A 1 


sx,n  *  "1i1Xi  '  <V‘-  3,1,1 


n 


X?  x  2 


s‘  -  n'1  J  Y?  y 

Y.n  &  i  -  CY„) 


Define  the  one- and  two- sample  t- statistics,  n  and  T2  n  respectively,  as 


Tl,n  ‘  ”i 

‘  -  V/<n  *  sy,„>^ 


where  expressions  of  the  form  r/0  are  interpreted  as 


+CO 

if 

r  > 

0 

0 

if 

r  = 

0 

-00 

if 

r  < 

0 
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Let  Cx  -  {F:  F  is  symmetric  about  0}  and  let  C2  *  {(F,  G):  F  -  G>. 

Then  for  every  a  >  0,  j  -  1  or  2,  W({T.  C.,  ja)  «  j  1(^(1  ♦  a/(l  +  a2)1*),  %)1 

j,n  n-ip  j  i  .  p 

where  for  0  <  p,,  p2  <  1,  I(pj_,  p2)  *  px  log  —  +  (1  -  px)  log  py . 

Further,  this  rate  of  convergence  is  achieved  by  a  t-statistic  based  on 
symmetric  Bernoulli  observations  *  That  is,  the  t-statistic  converges  most 
slowly  when  based  on  symmetric  Bernoulli  observations. 


00  •  00  2  2 

Definition  4:  Let  {X.}.  .,  {Y.}.  sv  ,  s  ,  and  indeterminant  :forms  be  as 

.  r  '  ""  J  rrT  X  X  J\fTl  J  jH 

2  2 

in  Theorem  3.  Let  the  F-statistic,  F(n),  be  given  by  s _ /s._  Let  the 

■  ■■  :  y,n 

shifted  F-statistic,  Fs(n),  equal  F(n)  -  1. 

It  is  reasonable  to  base  a  test  of  equality  of  variances,  assumed  to 
exist,  on  Fg(n),  with  large  values  indicating  rejection.  Under  the  null 
hypothesis,  F  (n)  +  0  a.s,  At  an  alternative  H  ,  F  fn)  +  a(HJ  a.s.,  where 
a(Ha)  is  assumed  positive.  We  will  now  determine-  the  large  deviation  rate  of 
Fg(n)  under  certain  paxametric  .assvanptions . 


Theorem  4:  Let  F  assign  mass  \  each  to  il.  That  is,  F  is  a  symmetric  Bernoulli 
distribution.  Let  be  mutually  independent  identically  dis¬ 

tributed  random  variables,  with  common  distribution  F.  Let  Fg(n)  be  based 
on  {Xi>Tsl,  {Y^}?^.  Then  for  any  a  >  0, 

-lim  if1  log  P(F  fn)  a  a)  -  Ips(l  +  (a/1  +  a)**),  Jj) 
n*» 


where  I C* *  *)  is  as  in  Theorem  3. 


Proof:  For  any  real  a, 

P(Fs(n)  a  a)  -  P(s^n/Sy>n  a  1  ♦  a)  »  P((l  -  X2)/(l  -  Y2)  a  1  +  a)  - 
P((l  +  a)Y2  -  X2  a  a)  s  P(Y2  a  a/(l  +  a);. 
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By  Chemoff's  Theorem, 


1  (lim  n’1  log  P (I*  a  a/(l  +  a))  -  (-I(%(1  ♦  (a/a  ♦  1)H),  h). 

n-*» 

Choose  and  fix  a,  1  >  e  >  0.  Now  P(Fg(n)  a  a)  ■  P((l  -  XJp/(l  -  Yj)  a  1  ♦  a)  a 

P(Yj  a  (a  ♦  e)/(a  ♦  1),  3^  <  «)  -  P(Y*  a  (a  +  c)/(a  ♦  1))  P (X*  <  c). 

But  lim  log  P(xf  <  e)  ■  0; 
n*»  ,  .i  n 

Hence  lim  lim  n”1  log  P(Fs(n)  a  a)  a- 

DrX»  n+»  1  _7 

lim  lim  n‘x  log  P(YJ  a  (a  ♦  e)/(a  +  -l))  » 

n+0  n^»  n  , 

lim  -Ift(l  ♦  ((a  +  e)/ (a  +  1))**),  h)  - 

e<0  Ift(l  +  ((a  ♦  ,)/(»♦  l))1*),  «. 

By  lines  1  and  2, 

-lim  n'1  log  P(F _(n)  a  a)  -  I(%(1  +  fe/a  +  l)*1),  »j).  0 
n*»  s 

2 

Theorem  5:  Lot  F  be  a  normal  distribution,  with  mean  y  and  variance  o  >0. 

w  * 

Let  {X^}^,  {Y^}^  be  mutually  •  independent  identically  distributed  random 
variables  with  common  distribution  F.  Let  Fg(n)  be  bused  on  {X^^, 

Then  for  any  a  a  0, 


-lim  n"1  log  P(F  (n)  a  a)  *  log(2(a  +  l)*1/ (a  +  2)). 

n-K»  a 


Proof:  Without  loss  of  generality,  let  y  ■  0,  c2  *  1.  Let  ^i^i»l 

be  two  sequences  of  mutually  independent  identically  distributed  random 

2 

variable  with  common  distribution.  Then  for  every  a  a  0, 

?(F  (n)  a  a)  = 
p-1  n-1 

P(  I  U./  I  V.  a  a  ♦  1)  * 
i=l  i«l 
n-1  n-1 


I' (a  +  1)V.)  = 
i*l  1 


P(  l  (U-  -  (a  +  l)V.)/(n  -  1)  a  0). 
i-1  1  1 
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By  Chemoff 's  Theorem 


lim  n'1  log  P(I  (U.  -  (a  ♦  l)V,)/(n  .l)iO)» 
i«l  1  1 

inf  log(l  +  2at  -  4 (a  +  l)t2)"*  - 
tiO 

log(2(a  +  l)5*/ (a  +  2)).  0 

In  Table  1,  we  display  I&(1  ♦  (a/ (a  +  1))S,  h)  and  -log(2(a  +  ify (a  +  2)) 
for  selected  values  of  a  >  0.  We  see  that  F  (n)  converges  to  zero  more  rabidly 
under  some  alternatives  w! len  the  null  distribution  of  the  underlying  observations 
is  normal  than  if  the  null  distribution  of  the  underlying  observations  is 
symmetric  Bernoulli.  Unlike  the  t -statistic,  the  F-statistic  does  not  converge 
most  slowly  when  the  underlying  observations  have  a  symmetric  Bernoulli 
distribution. 
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III.  Extremal  Large  Deviation  Rates  of  the  P- statistic.  Before  dealing  with 
the  F-r;-  :tistic,  which  is  used  to  test  for  equality  of  variances,  we  will 
consider  a  related  statistic  used  for  testing  the  equality  of  means  of  positive 
random  variables . 


Definition  4;  Let  be  mutually  independent  identically  dis- 

'  tributed  random  variables  with  common  distribution  F  c  G,  where 
G  *  [F:  J^dF  ■  1,  0  <  J^xdF(x)  <  »}.  Define  the  ratio  statistic,  R^,  as 
-  1,  where  7, 7  ,  arid  indeterminate  forms  are  as  in  Theorem  3. 

The  statistic  can  be  used  to  test  Hq :  EX^  ■  EY^.  Under  Hq,  R^  •*>  0 
a.c  »  Under  a  non-null  F,  R^  ♦  a(F)  o.s.  Without  loss  of  generality,  assume 
a(F)  >  0. 


T-.eoren  o.  Let  {Y, G,  and  be  ar,  in  Definition  4.  Then  for 

eiver/  a  >  0, 

W(Rt,  6,  a)  «  0. 

Jet  F  be  a  ib:ed  but  unspecified  distribution  in  6.  Clearly, 


C  <;  ,  G,  a)  s  -lim  n’A  log  Pp(R  a  a), 

r-  n+>  >  n 


>,-it  z  >  C  be  he  .  ?„■.  and  fis:ed.  Let  a  u  e/log (1  +  (a  )/4(a  +  1)),  and  let 

be  c.  G-r.ua-i  fa,  2.'  distribution.  Then 

i  .  n  n 

Urn  n  *  lo;  ?-(?,,  s  a)  -  lim  n"1  leg  PP(  J  X.  a  (a  +  1)  J  Y.)  - 
jh«  *  n->=»  *  i-1  1  i-1  1 


lie  n’A  leg  ?v.(  V  X.  -  (a  +  1)Y.  i0)  »  log  inf  t(t)  tp(- (a  ♦  l)t), 
n»»  *'  i“I  1  "  tiO 


r'.y:iX>£Z'*  ihrorcsi*,  ’-’here  <»(t)  -  (1  -  t) 


-a 
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By  elemmatary  methods,  log  inf  4>(t)  *('  (a  ♦  l)t)  ■  -e.  The  result  follows, 

tiO 

taking  the  limit  as  e  •*-  0.  0 

Before  determining  the  extremal  large  deviation  rate  of  the  F* statistic, 
some  preliminary  results  are  needed. 

2  2 

Lemma  1.  Let  x  tend  to  zero  from  above.  Then  1(4(1  ♦  x),  4)  *  x  / 2  +  0(x  ). 

Proof:  Expanding  1(4(1  +  x),  4)  as  a  Taylor  series,  the  result  follows. 

Lenina  2  (Jones  and  Sethuraman,  1978).  Let  (X^}"^  be  a  sequence  of  i.i.d. 
symmetric  random  variables. 

Then  for  every  sample  size  n  and  b  e  (0,  1) 

P(  l  V(  l  xi)1’  *  M  s  «P(-nIft(l  *  b).  «). 
i»l  i-1 

We  are  now  ready  to  determine  the  extremal  large  deviation  rate  of  the 
F- statistic  over  appropriate  classes. 

2  •  • 

Theorem  7.  Let  F  »  (F:  F  is  symmetric  about  0,  /x  dF  <  •*}.  Let  (U^  >»*V« 
be  two  sequences  of  mutually  independent  identically  distributed  random 
variables  with  cccmon  distribution  F,  where  F  e  F.  Let  F  (n)  be  based  on 
{¥-.i,  •  Then  for  every  a  *  0, 

WQPgW,  F,  a)  -  0. 

Proof:  Choose  and  fix  e  >  0.  It  is  sufficient  to  find  an  F  in  F  such  that 
lim  n"1  log  Pp(Fs(n)  is)  z  -e. 

n**»  ®  «* 

Let  o  be  chosen  as  in  Theorem  6.  Let  {X.}^,  ^ 

2 

independent  identically  distributed  random  variables  such  that  Xj  has  a 
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Gamna  (a,  1)  distribution.  Let  {ni}i*l  be  rautually  indePend 

identically  distributed  syanetric  Bernoulli  random  variables,  independent  o 

r  {Y.}“  , .  Let  F  (n)  be  based  on  (Vi-1  -  <"iXi}i-l 

“  l6iYi^i«l* 
n  ^2/  r  v2 


V*. 


(3) 

(4)  E(1 


Let  2  ■  1  '  (a  +  por  a  *  °’ 

(„,  ,  a)  -  J«,  m j^2  - ( j^)2 

r  1»1 

PF((  ?  n^)2  4  n  ?  X2  Z)  -  V,« l  «*>*  s  » j/i  2|(Xi’ 
F  1-1  1  1,1 

1  -  2  EPFCC  I  r,iX1)/(nIX2)'1  2  zVi>  Yjlj.j)  2 

*  j»l  A  X  1*1 

2  expC-nICHCl  +  Z*5).  Yi^i-1^  * 


p(-r\  I0s(l  +  A*  W  HZ  *  2/n)  1  {Xi ,  Yi* i»i^  s 
fl  -  2  exp(-nl(%(l  ♦  tf/n)*5),  *)))VZ  *  z/n), 


asymptotic  to  (1  -  2  exp(-l)) 


where  (4)  follows  from  (3)  by  Lenma  2. 

By  Lama  1  -  2  «p(-n  IftO  *  »  is 

By  direct  substi  'ution, 

PrCZ2  2/n)-PF(.|x2/jY2i2(a*l)n/(n-2)). 

I  1«1  1*1 

lim  n'1  lo?  lj(Ps(»)  2  a>  2  ^  n‘llog  ’’FtJiXi/i-lYi  2  3  *  15  ' 


Hence, 


IV** 


11 


One  is  tempted  to  conjecture  the  existence  of  a  subclass  of  F,  say  F*, 
such  that  W(Fs(n),  F*,  a)  >  0.  No  such  class  has  been  discovered,  although  a 
number  of  candidates  have  been  ruled  out.  Notice  that  the  construction  in 
Theorem  7  is  scale  invariant.  By  suitable  scaling,  this  construction  can  be 
made  to  satisfy  any  condition  on  the  absolute  first  moment,  the  second  moment, 
or  the  pth  percentile  of  the  underlying  distribution-.  Restricting  the 
underlying  observations  to  the  class  of  symmetric  and  bounded  distributions 
docs  not  yield  a  non- zero  extremal  large  deviation  rate,  as  can  be  seen  below. 

Theorem  8:  Let  H  •  {F:  F  is  symmetric  about  zero,  and  has  support  in  C-l,  +1J). 
Let  {X^}^,  be  two  sequences  of  mutually  independent  identically 

distributed  random  variables  with  common  distribution  F,  where  F  c  H.  Let 
rs(:0  be  based  on  {X.,  Y^"^.  Then  for  every  a  a  0,  WQ^Cn),  H,  a)  -  0. 

Proof:  Proceeding  as  before,  let  e  >  0  be  chosen  and  fixed. 

Let  II  be  the  distribution  that  assigns  mass  e  e  to  0  and  is  uniformly 
cvor  (-1,  +1)  with  probability  (1  -  e  e).  Then  for  every  a  i  0, 

lim  n"1  log  PH(Fg(n)  2  a)  i 

Il-KO 

lim  n"1  log  F^O^Ov)  3  +”)  = 

n*»  .  • 

lri  n'1  log  PH(s^  >  0,  sZ  -  0)  -  ■••• 

n-K»  - 

lim  n  i{log(l  -  e  ne)  +  log(e  e)>  = 
m<*> 

-e.  □ 
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IV.  Efficiencies  of  Tests  for  Equality  of  Variances 


Consider  the  problem  of  testing  for  equality  of  variances  of  two  popula¬ 
tions,  with  underlying  distributions  unspecified.  The  usual  procedure  is  to 
reject  the  null  hypothesis,  equality  of  variances,  if  the  statistic  Fs(n) 
exceeds  some  specified  value.  Call  this  test  T^.  Let  us  consider  a 
competitor  to  T^. 

Moses  (1963)  has  proposed  a  distribution- free  test  for  equality  of 

variances.  Moses  reconmends  randomly  allocating  (X^)v^  into  n  subsamples  of 

kn 

size  k,  and  calculating  sample  variances.  This  is  repeated  with  and 

the  two  collections  of  sample  variances  are  then  compared  by  means  of  the 
Wilcoxon  rank  sum  test.  Call  this  test  T2. 

It  is  known  that  the  half  slope  of  the  Wilcoxon  rank  sum  test  is  positive. 
Hence,  the  half  slope  of  T2  Ic  also  positive.  By  Theorem  7,  the  half  slope 
of  T^  is  zero  at  every  alternative.  Hence,  at  every  alternative,  the 
Bahadur  efficiency  of  the  F-test,  relative  to  Moses'  test,  is  zero. 

While  the  t-test  performs  relatively  well  against  distribution  free 
competitors,  the  F-test  performs  as  poorly  as  possible.  One  is  tempted  to 
propose  a  "--■‘■est  for  variances"  of  the  form 

S  -  (s2  -  s2  )/(s4  *  s4  )**. 

n  v  x,n  y,n"  l  x,a  y,n' 

The  statistic  SR  can  be  shown  to  be  a  monotone  increasing  function  of  Fg(n) 
if  F  (n)  >  0  and  a  monotone  decreasing  function  of  F  (n)  if  F  (n)  <  0.  Hence, 

5  5  5 

the  half  slope  of  is  zero  at  every  alternative,  just  as  the  half  slope  of 

F„(n)  is. 
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Deviation 

a 


.05 


.10 


.15 


.20 

.25 

.30 

.35 

.40 

.45 

.50 

.55 

.60 

.65 

.70 

.75 

.80 

.85 

.90 

.95 

1.00 

1.25 

2.50 

2.75 


Table  1:  Large  Deviation  Rates  of  the  F-statistic 


Normal  Observations 
-log(2(a  ♦  1)*V (a  +  2)) 
.00030 
.00114 
.00244 
.00415 
.00621 
.00858 
.01122 
.01652 
.01716 
.02041 
.02382 
.02736 
.03102 
,03479 
.03865 
.04257 
.04658 
.05064 
.05474 
.05889 
.08004 
.10147 
.12281 
.14384 


Bernoulli  Observations 

I&(1  *  (a/a  +  ** 

.02400 
.04617 
.06672 
.08582 
,10363 
.12029 
.13591 
.15058 
.16440 
.17744 
.18977 
.20144 
.21251 
.22304 
.22305 
.24259 
.25169 
.26038 
.26869 
.27665 
.31188 
,34102 
.36557 
.38658 
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Table  1 
(continued) 


Deviation 

Normal  Observations 

Bernoulli  Observations 

a 

-log(2(a  +  l^/Ca  +2)) 

I&(1  +  (a/a  +  l)3*),  H 

3.50 

.18455 

.42072 

4.00 

.22314 

.44737 

5.00 

.29389 

.48651 

6.00 

.35688 

.51406 

7.00 

.41334 

.53456 

n8.00 

.46436 

.55052 

9.00 

.51083 

.56332 

10.00 

.56358 

.57618 

1,1.00 

.59281 

.58264 

12.00 

,62934 

.59014 

13. GO 

.66344 

.59660 

14.00 

.69537 

.60225 

15.00 

.72542 

.60721 

70.00 

.85351 

.62526 

00 

00 

log  2 
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